"The highlighted tokens are primarily short morphemes, suffixes, or function words in various languages, often marking grammatical features such as case, tense, plurality, or forming part of proper nouns and place names. These tokens frequently appear at word endings or as standalone grammatical markers, reflecting their importance in morphological and syntactic structure."
Score Type | Accuracy | Precision | Recall | F1 score | TPR | TNR | FPR | FNR |
---|---|---|---|---|---|---|---|---|
detection | 0.52 | 0.512 | 0.86 | 0.642 | 0.86 | 0.18 | 0.82 | 0.14 |
fuzz | 0.48 | 0.49 | 0.96 | 0.649 | 0.96 | 0.0 | 1.0 | 0.04 |